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(54) Method and device for recording digital supplementary data 



(57) Television signals may include sub-titles which 
are broadcast as Teletext. The problem arises that sub- 
title information to be stored on a DVD record cannot be 
switched on and off individually when replaying the DVD 
record. Thus, there is provided a Teletext to sub-picture 
converter (6) converting the sub-title information in the 



Teletext signal (5) separated from the analog TV signal 
(1) together with color-size-position control signals (7) 
to a sub-picture data signal. This signal is fed to a sub- 
picture encoder (10) and a multiplexer (11) in order to 
obtain a DVD signal. Consequently, the user can handle 
the sub-title information as usual sub-picture informa- 
tion. 




Fig. 1 



CD 
00 



Q. 
LU 



Printed by Jouve, 75001 PARIS (FR) 



1 



EP 1 178 691 A1 



2 



Description 

[0001] The present invention relates to a method of 
recording digital supplementary data transmitted by a 
video signal. Furthermore, the present invention relates 
to a device for carrying out such method of recording 
digital supplementary data as well as to a method and 
device for retrieving supplementary data. 

Background 

[0002] According to the state of art video signals like 
analog TV signals are transmitted by broadcasting fa- 
cilities. The video signals include vertical blanking inter- 
vals which are required for the time it takes the electron 
gun in a television monitor's cathode-ray tube to move 
back to the top of the tube. Data can be transmitted in 
such vertical blanking intervals by a TV provider to spe- 
cial receivers. 

[0003] TV providers particularly include Teletext or 
videotext signals within the vertical blanking interval. 
Teletext is intended to provide information like news, 
weather forecast or program guide. Usually such Tele- 
text information is not related to the video content of the 
TV signal. However, TV provider may also transmit Tele- 
text subtitles in the vertical blanking interval or in the 
transport stream of a DVB stream which definitely be- 
longs to the transmitting video and audio signals. For 
the event that a consumer wants to record the audio and 
video signals together with the subtitle information, he 
has to activate the Teletext decoding so that the Teletext 
becomes part of the video picture. 
[0004] With the DVD Technology the recording of vid- 
eo pictures has been standardized to the DVD-VR 
standard. This standard provides the possibility of em- 
bedding Teletext data within the private user data of the 
pictu re layer which also encompass the Teletext subtitle. 
The disadvantages of embedding Teletext data within 
the private user data are firstly that a user usually does 
not want to use the complete Teletext and, seco ndly, that 
not all DVD-VR decoders presently available on the 
market support the retrieval of the embedded text data. 
Furthermore, the DVD-VR standard defines the embed- 
ding and decoding method for Teletext data as optional 
so that subtitle information cannot be decoded by a plu- 
rality of decoders. 

Invention 

[0005] In view of the above disadvantages it is an ob- 
ject of the present invention to provide a method and 
device for recording digital supplementary data trans- 
mitted by a video signal in an efficient way so that these 
supplementary data are available on a consumer's com- 
mand. 

[0006] According to the present invention this object 
is solved by a method of recording digital supplementary 
data transmitted by a video signal including the steps of 



generating a sub-picture unit based on said supplemen- 
tary data and recording said sub-picture unit on a reced- 
ing medium. A corresponding device for carrying out the 
method includes a recording unit for recording data on 
5 a recording medium, a supplementary data separation 
unit for separating that supplementary data from said 
video signal, and an encoding unit for generating a sub- 
picture unit. 

[0007] In other words, a Teletext subtitle information 
10 is transcoded into a DVD sub-picture stream, which can 
be stored compliantly in DVD-Video and DVD-VR as 
well. This is possible by transcoding the character set 
used for the subtitle into a sub-picture bitmap. 
[0008] According to a preferred embodiment the sup- 
's plementary data may be separated from the video signal 
and recorded on the recoding medium. This is being 
done for video signals exclusively carrying supplemen- 
tary data without video data. Alternatively, the supple- 
mentary data and the video data may be separated from 
20 the video signal and recorded together on the recording 
medium. 

[0009] Preferably, the supplementary data are trans- 
mitted in the vertical blanking interval of the video signal. 
An example of such supplementary data is Teletext or 

25 Closed Caption data. 

[0010] Furthermore, the presence of supplementary 
data in the video signal may be detected automatically. 
If supplementary data are actually detected, they may 
be recorded together with video data on the recording 

30 medium. Thus, a subtitle as supplementary data may be 
recorded together with the video data stream on the re- 
cording medium. 

[0011] Additionally, the position of the Teletext on the 
screen may be adjusted individually. Therefore, the sub- 
35 picture unit includes at least one positioning command 
indicating the retrieval position of the supplementary da- 
ta in a main picture. 

[001 2] Several further commands may be included in 
the sub-picture unit so that the supplementary data may 

40 be displayed in various shapes. For example one or 
more command for positioning the sub-picture within a 
main picture, for setting a background color, for setting 
a character set color, for setting a character set size, for 
setting a character set type or the like may be encoded 

45 within the sub-picture unit. Thus, the colors of the char- 
acter and character background can be saved in the 
sub-picture stream. Moreover, the character color and 
size, the sub-picture background color, for instance 
transparent, semitransparent, black, inverted, etc., and 

50 the sub-title position for instance vertical or horizontal, 
within the video display may be individually controlled 
by the user during encoding and be stored in the sub- 
picture bit stream. 

[001 3] Finally, the characteristic of displaying the sub- 
55 picture may vary temporarily in order to adapt for exam- 
ple, the color of the sub-picture to the main picture or 
background of the main picture. 
[0014] The above described method steps and the 
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corresponding features may be implemented as a com- 
puter program for controlling the recording steps. Usu- 
ally such a computer program is stored on an appropri- 
ate recording medium, for example on a digital versatile 
disc (DVD) or other common media like CDs. 
[001 5] A method and device for retrieving the supple- 
mentary data by reading the sub-picture units and de- 
coding them is also provided by the present invention. 
[0016] The advantages of the present invention are 
on the one hand that every standard DVD-Video player 
and DVD-video recorder is able to decode sub-picture 
streams including the supplementary data and, thus, 
these data may be displayed under the control of the 
user. On the other hand no specific hardware is neces- 
sary for the retrieval when the original Teletext subtitles 
are transcoded into a sub-picture stream. 

Drawings 

[0017] Exemplary embodiments of the invention are 
illustrated in the drawings and are explained in more de- 
tail in the following description. 

In the Figures: 

[0018] 

Figure 1 shows a block diagram of the device ac- 
cording to the present invention; 

Figure 2 shows an example of a Teletext row 0; 

Figure 3 shows an example of a Teletext row 22; 

Figure 4 shows a sub-picture color look-up table; 
and 

Figure 5 shows a sub-picture unit according to the 
present invention. 

Exemplary embodiments 

[0019] Figure 1 shows a block diagram of an device 
according to the present invention. The device includes 
a separator 2, which receives an analog TV signal. The 
video information inclusive Teletext data is modulated 
on the picture carrier frequency in the well known man- 
ner. The audio information is likewise modulated on the 
audio sub carrier frequencies for stereo sound. The 
Teletext data is digitally transmitted in a video-blanking 
interval of the TV signal. The separator 2 separates from 
the TV signal an FBAS signal 4 and an audio signal 3. 
This is done with known filter stages and demodulators. 
The FBAS signal is fed to a Teletext decoder 12 where 
the Teletext data is recovered from the FBAS signal in 
the known manner. The Teletext data received by the 
separator 2 have a specific, commonly used digital for- 
mat, published in the Teletext Standard. The Teletext 



format is described in more detail in connection with Fig- 
ures 2 and 3. 

[0020] The Teletext data stream 5 output by the Tele- 
text decoder 12 is input into a Teletext analysis unit 6. 

5 Furthermore, a color-size-position control signal 7 is 
optinally input into the Teletext analysis unit 6. The color- 
size-position control signal 7 serves for individually con- 
trolling the color, the size and the position of the Teletext 
or sub-picture, respectively, on the video screen. Thus, 

10 the output signal of the Teletext analysis unit 6 contains 
Teletext data as well as control data as to the color, size 
and position of the sub-picture. 

[0021 ] The Teletext signal originally contains the Tele- 
text data and one or more commands for setting the 

15 background color and the color of the character set, 
commands f or setti ng the character set size and the type 
of the character set. This is why the color-size-position 
control signal 7 is optional. In a simple embodiment the 
Teletext analysis unit 6 relies on the information embed- 

20 ded in the Teletext data stream. The color information is 
e.g. defined in characters 1 -3 of the Teletext rows 1 -23 
(see also Fig. 3). The position information is simply de- 
duced from the Teletext row number. E.g. for Teletext 
row number 22 it is evident that the information needs 

25 to be inserted at the bottom of the picture. The size in- 
formation is also simply deducable from the teletext row 
number. It is simply 1/24 of the display height and thus 
can be fixed in a simple embodiment. It is the task of 
teletext analysis unit 6 to extract all this information from 

30 the Teletext data and to provide the downstream sub- 
picture encoder 10 therewith. Another task is to select 
the right Teletext page and the corresponding display 
characters from the Teletext data stream 5 and to for- 
ward the selected data to the sub-picture encoder 10. 

35 Further commands like one or more commands for po- 
sitioning the sub-picture in a video picture, commands 
for setting individual background colors or the like may 
be added at the receiver side or used for replacing orig- 
inal Teletext commands. 

40 [0022] The audio signal 3 is input into an audio en- 
coder 8. The audio encoder 8 digitalises the audio signal 
and encodes the audio signal according to the DVD 
standard, for example. Simultaneously, a video encoder 
9 digitalises the video signal and encodes the video sig- 

45 nal 4 received from the separator 2. This is preferably 
an MPEG encoding unit, such as MPEG1, MPEG2, 
MPEG4, MPEG7-encoderorthelike. Also other encod- 
ers can be used alternatively, e.g. JPEG encoder. A sub- 
picture encoder 1 0 provided parallel to the audio encod- 

50 er 8 and the video encoder 9 encodes the signal output 
from the Teletext analysis unit 6. Consequently, the sub- 
picture stream output from the sub-picture encoder 10 
includes Teletext data as well as further encoded com- 
mands. In the sub-picture encoder 10 a DVD standard 

55 conform sub-picture unit is generated as described in 
the DVD standard. 

[0023] The signals output from the audio encoder 8, 
the video encoder 9 and the sub-picture encoder 1 0 are 
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input into a multiplexer 11. This multiplexer 11 forms a 
digital data stream 1 3, for instance in DVD format, which 
may be recorded on a DVD disc. 
[0024] The structure of a digital Teletext signal will be 
described subsequently along with Figures 2 and 3. 
[0025] Figure 2 shows a typical Teletext row 0. The 
general structure of Teletext signals is provided by the 
international Teletext standard. Accordingly, the Teletext 
signal for one page includes 24 rows. The first row 0, 
like a header, includes control information. The row is 
formed by a sequence of hexadecimal numbers of two 
digits each. Thus, each code number is represented by 
8 bit. At the beginning of the row, the first three numbers 
representing the clock run-in and the framing code are 
fixedly set for a given type of Teletext. The following 
magazine number "2" represents the hundred of the 
Teletext page number. The next Teletext number repre- 
sents the number of the row. The next two numbers rep- 
resent the ten and the unit of the page number of the 
Teletext. The number of a sub-page of a Teletext page 
is coded within the next four hexadecimal numbers. 
Control codes for sub-title, new page, etc. follow. The 
flag C 6 set to "1 " indicates that the Teletext includes sub- 
title data and the flag is used to activate the transcoding 
process. 

[0026] The next rows of the Teletext signal contain 
specific information provided by the broadcasting facil- 
ity. Typically, sub-title information is sent within the last 
view rows. An example for such sub-title Teletext row is 
shown in Figure 3. The row 22 also consists of a se- 
quence of hexadecimal numbers. The beginning of the 
row 22 is identical with that of row 0, namely including 
the clock run-in and the framing code. The next hexa- 
decimal numbers represent the magazine and the row 
numbers. The next numbers are codes for the back- 
ground color, the character set color and the characters 
to be displayed. 

[0027] As can be seen from the above, a Teletext sig- 
nal is a sequence of numbers separated in several rows. 
Each code word has a specific meaning like page 
number, sub-title or background color. 
[0028] Now referring to Figure 4 it will be explained 
how a decoder decodes a specific function from a code 
word of the Teletext. Figure 4 shows a sub-picture color 
look-up table which represents a relation between a 
code number and a specific color. The system may pro- 
vide sixteen colors which are coded by the numbers 0 
to 15. Each number relates to a certain color. Thus, 
number "2" relates to color "green" and number "7" re- 
lates to color "white" for example. The second column 
in Fig. 4 starting from code "8" and ending at code "15" 
relates to the same colors as the left column, but there 
may be provided further colors or color mixtures related 
to the code words of the second column. Furthermore, 
this sub-picture look-up table may contain more or less 
than 1 6 code-color-relations. 

[0029] The sequence of hexadecimal numbers repre- 
senting the Teletext signal is transcoded into a sub-pic- 



ture unit according to the present invention. Such a sub- 
picture unit is shown in Figure 5. The general structure 
of a sub-picture unit (SPU) is specified in the DVD stand- 
ard, DVD Specifications for Read-Only Disc, part 3, Vid- 

s eo Specification, version 1 .0, August 3, 1996, chapter 
5.4.3 Sub-picture Unit(SPU). Accordingly, the sub-pic- 
ture unit comprises the sub-picture unit header (SPUH), 
pixel data (PXD) and display control sequence table 
(SP_DCSQT) which includes sub-picture display con- 

10 trol sequences (SP_DCSQ). SP_DCSQ describes the 
content of the display control on the pixel data. Each 
SP_DCSQ is seamlessly recorded, attached to the oth- 
er. 

[0030] As an example Figure 5 shows a sub-picture 

15 unit obtained by transcoding the Teletext signal indicat- 
ed in Figures 2 and 3 into the sub-picture unit format. 
The sub-picture unit starts with a sub-picture header 
(SPUH) including control information. The following part 
PXD represents the pixel data field, which comprises 

20 run-length coded bitmap data. The grey graphic field in 
Figure 5 represents the bitmap subtitle graphic, which 
is obtained by transcoding the subtitle characters of Fig- 
ure 3 into DVD sub-picture format. 
[0031] As described above the PXD is followed by the 

25 display control sequence table (SP_DCSQT). The 
SP_DCSQT may include several display control se- 
quences (SP_DCSQ). In the case of Figure 5 the 
SP_DCSQT contains two display control sequences, 
SP_DCSQ#0 and SP_DCSQ#1 . An example of thecon- 

30 tents of the display control sequences is also given in 
Figure 5. Accordingly, a start time (SP_DCSQ_STM) of 
SP_DCSQ#0 is set to 0. This means that a control se- 
quence starts at the fictitious time 0. Furthermore, the 
start address of the next SP_DCSQ 

35 (SP_NXT_DCSQT_SA) is setto SP_DCSQ#1 shown in 
the right half of Figure 5. The display of the sub-picture 
unit is started by the command STA_DSP The color of 
each pixel for the pixel data is set by the command 
SET_COLOR. In the present case the color of the back- 

40 ground pixels (bp) is set to 4. According to the look-up 
table of Figure 4, color 4 stands for "blue". Similarly, the 
pattern pixels (pp) are set to red color in accordance with 
the Teletext colors. 

[0032] The contrast mixture ratio between each pixel 
45 of the pixel data and the main picture is set by the com- 
mand SET_CONTR. In the present case this contrast is 
set to the maximum value 1 5. 

[0033] The sub-picture displaying the sub-title has to 
be placed within the main picture. Therefore, the display 
50 area of the pixel data are set by a rectangle with the 
command SET_DAREA. 

[0034] This command allows to set the display area 
individually by x and y coordinates. In the present case 
the location of the Teletext row 22 is transformed to the 
55 display area x=40..679, y=488..527. 

[0035] The address of the first pixel data used for dis- 
playing is set by the command SET_DSPXA. The cor- 
responding PXD start address is shown in the PXD 
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step of separating said supplementary data (5) from 
said video signal (1) and recording said separated 
supplementary data (5) on said recording medium. 

5 3. Method according to claim 1 , further including the 
step of separating said supplementary data (5) and 
video data (4) from said video signal (1 ) and record- 
ing said separated supplementary data (5) and said 
video data (4) on said recording medium. 

10 

4. Method according to one of the preceding claims, 
wherein said supplementary data (5) are transmit- 
ted in a vertical blanking interval of an analog video 
signal (1 ) or in the transport stream of a digital video 

15 signal, in particular DVB stream, preferably as Tele- 
text, Videotext, Electronic Program Guide or Closed 
Caption. 

5. Method according to one of the preceding claims, 
20 further including the step of automatically detecting 

the presence of supplementary data (5) in said vid- 
eo signal (1 ) and in case of their presence automat- 
ically recording them in said sub-picture unit togeth- 
er with video data (4) on said recording medium. 

25 

6. Method according to one of the preceding claims, 
wherein said supplementary data (5) include at 
least one subtitle. 

so 7. Method according to one of the preceding claims, 
wherein said sub-picture unit includes at least one 
positioning command indicating the position of said 
supplementary data in a main picture. 

35 8. Method according to claim 7, wherein the sub-pic- 
ture unit further includes one or more of the follow- 
ing commands: 

command for setting a background color, 
40 command for setting a pattern pixel color. 

9. Method according to one of the preceding claims, 
wherein the characteristic of displaying said sub- 
picture is variable temporarily, preferably for adapt- 
45 ing the color of the sub-picture to the picture or 
background of the picture. 



graphic in Figure 5. 

[0036] The sub-picture display control sequence 
SP_DCSQ#0 is terminated by the command CMD_END 
like each SP_DCSQ. 

[0037] The second and last display control sequence 
SP_DCSQ#1 of this exemplary SP_DCSQT is shown in 
the right half of Figure 5. Accordingly, the execution stop 
time is set to 527 units corresponding to 6 seconds. The 
following command relating to the start address of the 
next sub-picture display control sequence does not pro- 
duce any effect in the present case since SP_DCSQ#1 
is the last one of the SP_DCSQT The command 
STP_DSP serves to stop the display of a sub-picture 
unit. As already described above the command 
CMD_END terminates the display control sequence. 
[0038] The above described sub-picture unit is a part 
of a video object unit according to the DVD standard. 
Thus, according to the present invention no specific 
hardware is necessary to display Teletext on the video 
screen under the control of the user. 
[0039] Multiple modifications of the disclosed embod- 
iments are possible. E.g. the video signal need not nec- 
essarily be an analog video signal. Alternatively it can 
be a digital video signal, in particular a DVB (Digital Vid- 
eo Broadcast) signal. 

[0040] It is not necessary that video data and sub-pic- 
ture data are simultaneously recorded. It can be the 
case that Teletext or supplementary information is ex- 
clusively transferred in a video channel. In this case, on 
the recording medium only a sub-picture stream is re- 
corded. The teletext analysis unit 6 and the sub-picture 
encoder 1 0 can be implemented also in software. Alter- 
natively, they can be implemented in two separate or 
one single hardware block. 

[0041] For reproducing the recorded supplementary 
data information a conventional DVD player or a corre- 
sponding DVD Video recorder with sub-picture decoder 
can be used. 

[0042] The invention can also be used in a PC-based 
video recorder. In this case, the inventive method is per- 
formed in a corresponding computer program, like the 
computer programs for DVD software decoders. The re- 
cording medium can in this case be simply the hard disk 
of the PC. 



Claims 

1 . Method of recording digital supplementary data (5) 
transmitted by a video signal (1 ) including the steps 
of, 

generating a sub-picture unit based on said 

supplementary data (5) and 

recording said sub-picture unit on a recording 

medium. 

2. Method according to claim 1 , further including the 



10. Computer program product with program steps ac- 
cording to one of the preceding method claims. 

50 

11. Recording medium including a computer program 
according to claim 10. 

12. Device for carrying out the method according to one 
55 of the claims 1 to 1 0 including 

a recording unit for recording data on a record- 
ing medium, 
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a supplementary data separation unit (2) for 
separating said supplementary data (5) from 
said video signal (1), 

an encoding unit (10) for generating a sub-pic- 
ture unit with said supplementary data (5) to be 5 
recorded on said recording medium. 

13. Device according to claim 12, further including a 
compression unit (9) for video data (4), particularly 

an MPEG video encoder, for transforming video da- 10 
ta into an MPEG data stream. 

14. Device according to claim 1 2 or 13, further including 
a Videotext or Teletext decoder or a Closed Caption 
decoder or an EPG decoder. 15 

15. Device according to claim 12, 13 or 14 operable as 
video recorder recording the data on a recording 
disk, particularly a DVD recorder. 

20 

16. Device according to one of the claims 12 to 15, fur- 
ther including a decoding unit for decoding said sub- 
picture unit for reproducing said supplementary da- 
ta. 

25 

17. Device according to one of the claims 1 2 to 1 6, fur- 
ther including a decompression unit, particularly an 
MPEG video decoder for generating a video signal 
from said MPEG data stream. 

30 

18. Method of retrieving digital supplementary data re- 
corded according to one of the claims 1 to 9 includ- 
ing the steps of, 

reading said sub-picture unit from the recording 35 
medium and 

decoding said sub-picture unit for displaying 
said supplementary data on a video screen. 

19. Device for carrying out the method of claim 18 in- 40 
eluding 

reading means for reading said sub-picture unit 
from said recording medium and 
decoding means for decoding said sub-picture 45 
unit for displaying said supplementary data on 
a video screen. 
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